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Detection  of  Point  Objects  in  Spatially  Correlated 
Clutter  Using  Two  Dimensional  Adaptive  Prediction 

Filtering* 


Tarun  5ont^,  James  R.  Zeidler^ ,  and  Walter  //.  Ku^ 
t  Department  of  Electrical  and  Computer  Engineering, 
University  of  California  at  San  Diego, 

La  Jolla,  <JA  921)93-0407. 

^Code  804,  Naval  Ocean  Systems  Center, 

San  Diego,  CA  92152-5000. 


Abstract 

This  paper  studies  the  performance  of  a  two  di¬ 
mensional  least  mean  square  (TDLMS)  adaptive  fil¬ 
ter  as  a  prewhitenmg  filler  for  the  detection  of  small 
signals  in  infrared  image  data.  The  spatially  broad 
clutter  with  long  correlation  length  is  seen  to  be  nar¬ 
rowband  in  the  two  dimensional  frequency  domain. 
This  narrowband  clutter  is  predicted  and  subtracted 
from  the  input,  leaving  the  spatially  small  signal  in 
the  residual  output.  The  output  energy  in  the  resid¬ 
ual  and  prediction  channels  of  such  a  filter  is  seen  to 
depend  on  the  correlation  length  of  the  various  com¬ 
ponents  in  the  input  signal,  thus  permitting  the  sepa¬ 
ration  of  short  correlation  targets  from  the  longer  cor¬ 
relation  clutter.  False  alarm  improvements  and  de¬ 
tection  gains  obtained  by  using  this  detection  scheme 
on  thermal  infrared  sensor  data  with  known  target 
points  is  presented. 

1  Introduction 

This  paper  addresses  the  problem  of  detecting 
small  objects  of  very  small  spatial  extent  masked  by 

*Thi»  work  *u  supported  by  the  NSF  I/UC  Research 
Center  on  Ultra  High  Speed  Integrated  Circuit*  and  Systems 
(ICAS)  at  the  University  of  California,  San  Diego,  The  Office 
of  Naval  Research  and  the  National  Science  Foundation  under 
grant  #ECD89-16669  and  the  U  S.  Naval  Command  Control 
Ocean  Surveillance  Center,  R.D.T.IcE.  Division's  Independent 
Research  Program 


large  and  correlated  clutter  :n  image  data.  Methods 
based  on  image  models  and  prediction  of  clutter  are 
often  applied  to  such  applications  [1,2],  In  the  ab¬ 
sence  of  a  well  defined  model  for  the  image  data,  the 
relevant  parameters  of  the  image  clutter  have  to  be 
estimated.  Further  in  the  case  of  nonstationary  clut¬ 
ter  these  parameters  may  have  to  be  continuously 
updated,  before  cancellation  can  be  done.  One  di¬ 
mensional  adaptive  linear  prediction  filters  have  been 
applied  to  the  detection  of  narrow  band  signals  em¬ 
bedded  in  non-station  ary  noise  as  well  as  to  the  re¬ 
moval  of  narrow  band  interference  from  broad  band 
data  [3-5]-  In  the  first  case  a  narrow  band  signal 
of  interest  is  extracted  from  the  prediction  channel 
of  the  adaptive  filter.  In  the  second  case  the  broad 
band  signal  of  interest  is  extracted  from  the  residual 
error  of  the  adaptive  filter  [3,4]. 

Adaptive  filters  analogous  to  the  LMS  and  lat¬ 
tice  implementations  in  one  dimension,  have  been 
recently  extended  to  two  dimensions  with  applica¬ 
tions  in  image  processing  [6,7].  These  algorithms 
update  the  filter  weights  based  on  the  spatial  coher¬ 
ence  between  the  signal  and  noise  components  of  the 
data  and  minimize  the  variance  of  the  prediction  er¬ 
ror  (residual)  without  explicit  assumptions  about  the 
noise  statistics.  In  this  paper  the  performance  of  two 
dimensional  least  mean  square(TDLMS)  adaptive  fil¬ 
ters  in  the  line  enhancer  configuration  [8,9]  for  the  de¬ 
tection  of  small  targets  is  studied.  The  components  of 
the  input  image  data  are  seen  to  be  separated  based 
on  their  correlation  lengths.  Thus  long  correlation 
clutter  is  predicted  and  can  be  cancelled  from  the  in¬ 
put  with  the  residual  containing  the  signal  of  interest. 
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Figure  1:  The  Two  Dimensional  LMS  Adap¬ 
tive  Filter. 


A  detector  based  on  TDLMS  prewhitening  filters  is 
applied  to  thermal  multispectral  infrared  sensor  data 
with  an  appreciable  decrease  in  the  number  of  false 
alarms. 

Section  2  describes  the  TDLMS  filter  used  briefly. 
Section  3  describes  the  separation  of  the  input  image 
energy  into  two  channels,  the  prediction  and  the  er¬ 
ror  channels  based  on  the  correlation  lengths  of  the 
various  components  of  the  input  image.  Section  4  de¬ 
scribes  the  gain  obtained  by  such  a  filter  anu  its  de¬ 
pendence  on  the  adaptive  time  constant  of  the  filter. 
Section  5 'describes  the  application  of  such  prepro¬ 
cessing  on  a  single  band  image  from  a  multi-spectral 
data  set  and  the  improvement  in  the  false  alarm  rate 
obtained. 


2  The  TDLMS  Filter 

The  TDLMS  adaptive  filter  [6]  shown  in  Fig.  1  pre¬ 
dicts  an  image  pixel  as  a  weighted  average  of  a  small 
window  of  pixels  as 


N-1N-1 

%")=EEW<(,'t)X(m-,'n-i)  (*) 

1=0  k—Q 

where,  X  is  the  input  image  of  size  M  x  M ,  Y  is 
the  predicted  image  and  Wy  is  the  weight  matrix  at 
the  j,h  iteration.  The  window  size  (and  hence  the 
weight  matrix)  is  N  x  N.  If  the  image  is  scanned 
lexicographically,  j  =  mM  +  n.  The  predicted  pixel 
value  is  compared  with  a  reference  image  ,D(m,n), 
which  is  a  shifted  version  of  the  primary  image  in  the 
line  enhancer  configuration.  The  error  is  then  found 
as 

E(m,n)  =  (j  =  D(m,n)  -  Y(m,n).  (2) 

In  the  absence  of  any  knowledge  of  the  statistics  of 
the  input,  the  LMS  algorithm  uses  instantaneous  es¬ 
timates.  Then,  the  steepest  descent  algorithm  leads 
*°  the  weight  update  equation 

Wj  +  ,(/,  k)  =  Wj  +  —  ltn  —  k)  (3) 
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Figure  2:  A  two  stage?  filtering  and  detection 
process 


Figure  3:  Signal  with  two  components:  object 
of  interest  at  (100,100)  with  corre¬ 
lation  spread  of  cr2  =  2  and  spurious 
component  at  (200,200)  with  corre¬ 
lation  spread  of  tr2  =  98. 


In  our  implementation  a  causal  window  with  quarter 
plane  support  and  a  left  to  right  lexicographic  scan 
were  used. 


3  Separation  by  Differences  in  Corre¬ 
lation  Lengths 

In  this  section  we  present  the  results  obtained  by 
applying  the  two  stage  augmented  detector  shown  in 
Fig. 2  to  infrared  image  data.  The  adaptive  filter  used 
for  prewhitening  was  the  two  dimensional  adaptive 
LMS  filter  described  in  section  2.  The  image 

used  was  channel  4  of  a  6  channel  data  set  collected 
by  the  NASA  Thermal  Infrared  Multispectral  Scan- 
ner(TIMS)  sensor  and  includes  a  rural  background 
over  the  hills  of  Adelaide,  Australia  (!0j  This  sec¬ 
tion  includes  performance  data  from  injected  point 
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Figure  4:  The  residual  channel  output  for 
Fig.15.  TDLMS  was  used  with  a  3x3 
window  and  ft  —  le  —  7.  LSBR  at 
(100,100)  =  16.024dB  and  LSBR.  at 
(200,200)  =  -16.75dB. 


objects  in  TIMS  sensor  output  data.  The  injected 
objects  were  utilized  to  illustrate  the  performance  of 
the  TDLMS  filter  for  known  object  parameters. 

To  study  the  ability  of  the  TDLMS  prewhitener 
to  separate  signals  based  on  spatial  correlation,  sim¬ 
ulation  studies  were  conducted  with  varying  signal 
spread.  The  infrared  signal  model  developed  by  Chan 
et.  al.  [11]  was  used  for  these  simulations.  This  model 
leads  to  a  Caussian  intensity  function  for  the  object, 
of  the  form 


l{x,y)  =  Te 


(4) 


where  F  is  the  maximum  value  of  the  object  intensity 
function,  (*o,yo)  is  the  position  of  the  center  of  the 
object,  and  (<rx,<ry)  define  the  spatial  spread  of  the 
object. 

Two  objects  with  symmetric  Gaussian  intensity 
functions  (<rr  =  <rv)  defined  by  Eq.4  were  inserted  in 
the  infrared  background.  Fig. 3  shows  an  image  with 
the  two  components  inserted  in  the  background.  One 
is  the  object  of  interest  (at  pixel  location  100,100) 
which  is  a  Gaussian  shape  with  cr2  =  2  and  the  other 
is  a  component  of  the  same  shape  but  with  a2  =  98. 
Fig. 4  shows  the  output  of  the  TDLMS  whitener  for 
this  case,  where  the  component  of  the  input  with 


Figure  5:  Energy  at  the  pixel  of  interest  in  the 
output  of  the  TDLMS  as  a  function 
of  the  correlation  length. 


Figure  6:  Energy  at  the  pixel  of  interest  in  the 
prediction  channel  of  the  TDLMS  as 
a  function  of  the  correlation  length. 


a2  =  2  is  seen  to  be  present,  while  the  output  for 
the  a 2  =  98  case  is  absent. 

Figure  5  shows  the  energy  at  the  pixel  of  interest 
in  the  residual  channel  output  of  the  TDLMS  filter 
as  a  function  of  the  signal  correlation  length  (cr2) 
The  pixel  intensity  at  the  output  was  observed  for  an 
object  defined  by  Eq.4.  It  is  seen  that  as  the  correla¬ 
tion  length  increases,  the  output  energy  at  the  pixel 
of  interest  decreases.  Further,  as  shown  in  Fig.6,  the 
energy  in  the  prediction  channel  of  the  TDLMS  filter 
correspondingly  increases  as  the  correlation  length  in¬ 
creases.  It  should  be  noted  that  the  prediction  chan¬ 
nel  output  always  contains  the  energy  due  to  the  non 
zero  mean  of  the  image  which  is  seen  in  Fig.6  as  a 
base  level  of  1.3  x  104. 

In  both  these  plots,  depending  on  ft,  three  regions 
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Figure  7:  Energy  at  the  pixel  of  interest  in  the 
output  of  the  Local  Demeaning  fil¬ 
ter  as  a  function  of  the  correlation 
length. 


can  be  defined  for  this  TDLMS  adaptive  filter: 

♦  For  objects  with  very  small  correlation  length, 
the  energy  is  contained  almost  totally  in  the  out¬ 
put  channel. 

♦  For  objects  of  long  correlation  length,  the  energy 
is  absent  from  the  output. 


Figure  8:  Gain  vs.  p  for  the  Adelaide  back¬ 
ground  with  one  pixel  signal  at 
(100,100). 


sensitive  to  changes  in  the  input,  and  some  of  the 
energy  from  the  signal  of  interest  is  also  predicted  and 
cancelled.  The  misadjustment  noise  in  the  adaptive 
filter  weights  increases  with  p  and  is  another  factor 
contributing  to  the  drop  in  gain  as  p  increases. 


5  Reduction  in  False  Alarm 


•  For  objects  of  intermediate  correlation  length, 
there  is  a  partial  decorrelation  between  the  input 
and  reference  channels.  In  such  cases  the  energy 
of  the  object  is  split  between  both  channels. 

A  similar  plot  for  the  local  demeaning  filter  is 
shown  in  Fig.7,  and  it  is  seen  that  the  local  demean¬ 
ing  filter  is  not  able  to  provide  a  clear  boundary  be¬ 
tween  the  two  regions  of  differing  correlation  spread. 
Thus  we  see  that  the  TDLMS  is  able  to  separate  the 
object  of  interest  from  the  clutter  based  on  their  cor¬ 
relation  spread. 

4  Dependence  on  the  Adaptive  Time 
Constant 

Fig. 8  shows  the  behavior  of  the  TDLMS  filter  as 
a  function  of  p  for  a  one  pixel  signal  at  two  different 
signal  intensities.  There  is  an  optimum  value  of  p  at 
which  the  maximum  gain  is  obtained.  If  p  is  less  than 
this  optimum  value,  the  filter  is  not  able  to  converge 
to  the  statistics  of  the  clutter.  Hence  the  residual 
channel  contains  some  component  of  the  correlated 
clutter  leading  to  a  reduced  gain.  IF  the  value  of  p  is 
higher  than  the  optimum,  the  adaptive  filter  is  very 


In  [10J  Hoff  et.  al.  identified  14  pixels  which 
contained  small  objects  in  the  TIMS  sensor  data  de¬ 
scribed  above.  The  14  pixels  were  identified  on  the 
basis  of  multispectral  data  in  the  6  separate  bands. 
The  locations  designated  in  [10]  are  illustrated  in  by 
boxes  in  Fig.9.  The  pixel  intensities  at  the  output 
of  the  TDLMS  filter  (residual  channel)  is  shown  in 
Fig.  10. 

Fig.  11  shows  a  high  resolution  intensity  plot 
around  the  pixel  (199,92).  As  seen  in  the  figure,  this 
pixel  has  a  very  high  Local  Signal  to  Background  Ra- 
tio(LSBR)  and  this  causes  the  object  to  be  predicted. 
Fig. 12  shows  the  corresponding  output  for  this  pixel. 
It  is  seen  that  there  are  a  number  of  pixels  in  the 
local  region  with  comparable  intensity. 

Fig.  13  is  a  similar  high  resolution  plot  around  the 
pixel  (188,25).  In  this  case,  due  to  the  low  LSBR,  the 
output  (shown  in  Fig.  14)  is  seen  to  contain  energy 
due  to  the  object  pixel  and  there  is  a  vast  improve¬ 
ment  in  the  detectability. 

Though  there  is  a  loss  in  LSBR  at  some  pixels  it 
is  seen  that  the  detection  performance  of  the  filter 
improves  considerably  when  the  input  image  is  pro¬ 
cessed  by  the  TDLMS  adaptive  filter.  For  a  threshold 
set  to  detect  all  14  of  the  signals  defined  in  [10],  the 
number  of  false  alarms  in  the  image  is  significantly 
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1 1  i  1 1  resolution  intensity  pint  ,,)' 
a  33x33  wm. low  annuel  tie'  pixel 
(199.92)  l»ef.>re  processing. 


Figure  9:  The  infrared  image  data  with  the  1*4 
pixels  of  interest.  Note  that  some 
objects  are  clustered  close  to  each 
other  their  enclosing  boxes  overlap. 


igure  1'2:  High  resolution  intensity  plot  of 
a  33x33  window  around  the  pixel 
(190.92)  after  processing. 


□ 


□ 


□ 


Figure  10’  The  infrared  image  data  output 
from  TDLMS  adaptive  fiter  for 
Fig.  20. 


Figure  13:  High  resolution  intensity  plot  of 
a  33x33  window  around  the  pixel 
(188,235)  before  processing. 


Figure  11  High  resolution  intensity  p 
a  33x33  window  around  the 
(188.235)  after  processing. 


1 


Figure  15:  False  alarms  in  the  Adelaide  image 
for  known  objects  as  the  percentage 
of  objects  detected  is  lowered. 
TDLMS  was  used  with  (J  =  le  —  7. 


reduced.  If  the  detection  criterion  is  changed  to  re¬ 
duce  the  number  of  detected  objects  the  number  of 
false  alarms  in  the  image  are  further  reduced.  A  plot 
of  the  percentage  of  objects  detected  as  a  function 
of  the  number  of  false  alarms  per  pixel  is  shown  in 
Fig. 15.  A  similar  plot  for  the  local  demeaning  filter 
is  also  shown  in  this  figure  and  it  is  seen  that  for  a 
fixed  number  of  false  alarms  per  pixel  the  percentage 
of  of  objects  detected  is  much  higher  when  the  data 
is  processed  with  the  TDLMS  based  adaptive  filter 
than  with  the  local  demeaning  filter. 


6  Conclusions 

The  line  enhancer  using  a  TDLMS  adaptive  pre¬ 
diction  filter  was  applied  to  the  problem  of  detecting 
a  small  object  in  infrared  backgrounds.  It  is  seen  that 
for  correlated  background  clutter,  the  adaptive  fil¬ 
ter  predicts  the  background.  The  filter  residual  then 
contains  the  signal  of  interest,  without  the  cluttering 
background. 

The  prediction  characteristics  of  the  TDLMS  filter 
were  seen  to  depend  on  /j  and  permit  the  separation 
of  components  in  the  input  of  differing  correlation 
lengths.  This  allows  the  detection  system  to  distin¬ 
guish  between  a  signal  of  interest  and  a  background 
cluttering  phenomenon  It  is  seen  that  this  cancella¬ 
tion  of  background  clutter  leads  to  a  reduction  in  the 
number  of  false  alarms  obtained  for  any  given  thresh¬ 
old  of  the  detector.  For  real  data,  it  is  seen  that, 


though  the  background  clutter  is  not  stationary,  the 
TDLMS  filter  is  able  to  predict  parts  of  the  clutter 
and  cancel  it,  leading  to  an  appreciable  improvement 
in  the  detection  performance. 
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